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ABSTRACT 



A profile of Title I and III reading program 
evaluators from data collected on a survey of 299 evaluators was 
made. The survey consisted of four sections: (1) The 

Evaluator — information on his educational background and training and 
on the programs with which he was connected; (2) Data 

Collection — information on the sorts of data the evaluator collected; 
(3) Reporting — information on the nature of the reports made and for 
whom they were intended; and (4) Tests — information on the types of 
tests used in the evaluations. Surprisingly few (30.4 percent) of the 
evaluators had had any formal course work in evaluation, yet 79.3 
percent were responsible for writing evaluation reports, and the 
majority were responsible for evaluating objectives of projects, 
instructional procedures, materials, and staff. The majority of the 
evaluators developed criteria for evaluation from information from 
local teachers and consultants. It was questionable whether the 
teachers were actually evaluated. Most evaluation data came from 
examination of testing programs which are described in detail. Most 
reports were to state departments of education and most were written 
only to meet federal regulations. Tables of data, the survey, and 
survey responses are included. (AL) 
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Analysis of Selected Items from Survey Form 

The attached data is derived from 299 Survey Forms which were com- 
pleted by evaluators of leading Programs. Some information is extremely 
limited in that only a small percentage of evaluators actually responded 
to the item. 

Items 8, 10, 11, 13, 15* and 16 (pages U> 5* and 6 of questionnaire) 
received only a small percentage of responses. The apparent reason for 
this is that these questions were asked contingent upon preceding answers. 
If a prior answer was "yes," then the next question was applicable. The 
total response was thus reduced in proportion to the percentage of the 
preceding response pattern. Various comparisons can be developed through 
a careful analysis of all given data. The purpose of this summary is to 
illustrate some highlights which are seen within and between various sec- 
tions of this survey. 

I . The Evaluator 



This section was designed to gather information about the preparation 
of the individuals involved in evaluation and some basic information about 
the programs with which they were connected. The title of the actual po- 
sition varied from Assistant Superintendent to Evaluator to Teacher. Ob- 
viously, the title alone implied responsibilities beyond the scope of 
evaluation. In short, many individuals wore many hats. In spite of this, 
237 (79.3/0 respondents (N. 299) indicated that they were responsible for 
writing an evaluation report. This large percentage must be considered 
when question U, page 2, is reached. Only 91 (30. h% evaluators, N. 299) 
actually took course work entitled '’Evaluation" in a formal academic 
program. The significance of this is further developed when questions 7, 
9, 12, and 1H (pages U and 5) in the data collection section are reached. 
Two-hundred twenty-five (75.3$) respondents vrere requested to evaluate 
the objectives of their projects ; 1HH (1*8.2;?) were requested to evaluate 
instructional procedures; 15 H, (51.5/?) participated in the evaluation of 
materials and 153 (5l»2^) were involved in the evaluation of Title I 
Staff. There is an obvious dichotomy between formal training and occu- 
pational requirements in this one aspect of the evaluators’ profile. 

II. Data Collection 



One indicator of the evaluator' s perception of his effectiveness 
might be found in question 11 (page 5) in the data collection section. 

The response was asked contingent upon a "yes" answer to the preceding 
question. The percent was calculated on the total sample (H. 299) Thus, 
(N121), HO. 5# of the evaluators made recommendations for change and 11 1 
felt that change was made due to their suggestion. This is 31 ,7% of the 
total (N. 299). 

With respect to data collection for evaluation purposes, several items 
are especially noteworthy. First, in developing criteria for evaluation 
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materials, local teachers (Hi.. 7$) and "experts" (consultants) (12. HO were 
the primary source. Other Title I projects were noticeably low in pre- 
ference for developing criteria. Second, teachers were evaluated pri- 
marily by locally devised scales (33*8$). The second choice response to 
this item vras none (20.1$). Standard forms of evaluation were used by 
7$ of the respondents. Of course, 117 (39.1$) respondents did not re- 
ply to this question. Thus, the question arises; Were teachers evaluated? 
Third, the primary method of collecting data for total evaluation was an 
examination of the testing program (Ui|,.l$). (This is to be considered 
again in question 2U, p. 9, where 263 - M. 299 - respondents -88$ - in- 
dicated pre-test/post-test as their test design.) The second method was 
written reports from teachers (23»U$) and the third choice was discussion 
with teachers (16.1$). 

III . Reporting 

The recipient of the evaluator's report and information is another 
indication of the nature of the evaluator's role. The State Department 
of Education (Lt2.;?$), the Federal Government (l6.U$) and the local 
school board (22.h$) are the recipients of the evaluation reports. 
Significantly, pupils (1.7$), parents (.7$), community groups (.3$)> and 
the mass media (.3$) receive very little information concerning the re- 
sults of Title I projects. 

This is not so surprising when question 20 (page 7) is considered. 

The purpose of the report (in the eyes of the respondents) was, primarily, 
to meet Federal Regulations (UU.1$) Project status (26.8$) and future 
financial support ( 17.10 were also noted as being especially important. 

IV. Tests 



As was noted earlier, the dominant source of evaluative information 
regarding the reading projects was test data. The least reliable measures 
of this progress were, in question 22, page 8, Reports from supervisors 
(3.7$) , Pupils reading at grade level (U»7$), Parent response (.3$) and 
Classroom visitations (1.0$). Standardized tests (in question 23j page 8) 
were judged to be the most reliable measures of pupil progress. Academic 
grades on report cards were also considered to be reliable (32.8$) while 
reading grades were considered to be very unreliable (2$). 

A certain degree of confusion about tests is reflected in the response 
pattern to question 2$ 3 page 9. The standardized test score means var- 
ious things to various evaluators. Perhaps a common agreement on the de- 
finition of these terms might offer a stronger base for comparison of 
other responses. 

Familiarity with standardized tests for specific purposes is sugges- 
ted in the responses to qeustion 26 , page 10. The Doren Diagnostic was 
selected as the best choice for both estimating Phcnics-lJord Attack 
Skills (32 .U$) and Critical Reading Skills (U+.U$). The Spitzer Test was 
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selected as best for estimating study skills (30. U 5 ). The California 
Reading Test was selected for Paragraph Comprehension-Silent Reading 
(U 2 . 8 / 0 ) The jolch Test of 220 words was selected for sight vocabulary 
estimates ($ 6 . ?.%).■■ -Finally, the iJelson-Denny test was selected for se- 
condary level reading comprehension (32.1,o). 

The above observations are only a few of the many insights which 
this survey offers into the profile of reading program evaluators. Many 
inferences can be drawn from the data as it is assembled in this survey. 
The primary observations concerning this information is that it is de- 
scriptive only. The sample indicates; that 2 $% of the respondents had a 
degree beyond the Master's level, $ 1 .$% had three or fewer hours in 
statistics, 65.6$ had three or fewer hours in research design and 68.2$ 
had no courses in evaluation. The data in no way reflects the success 
or failure of the evaluator in his task. This composite only reflects 
the educational background of educators involved in reading program 
evaluation. ..Iso, the other data offered only gives a profile of 

perceptions and practices currently found in evaluation of reading pro- 
grams. 
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COMPARISONS OF SELECTED RESPONSES 



The following eight matrices are intended to illustrate some of the 
factors which are basic to the evaluators' profile. Essentially, there 
are two sets of comparisons. The first set (I, II, III, IV), relates 
the size of the evaluator' s district to the degree he has earned, and to 
his study of evaluation, research design and statistics. The second set 
(V, VI, VH, Vin) relates the same four items to his test score. 

To facilitate reading, it is useful to note that each cell contains 
three figures. The whole number, (in the upper left half), represents 
the number of evaluators responding to the particular cell. The decimal 
in the right triangle represents a percent figure of respondents. These 
figures are to be read across the matrix (right to left). The decimal in 
the bottom triangle represents the per cent of responses to the column. 
These figures are to be read down the column. 
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I 

DE0H3E/SIZE 




Degree earned by- 
re snondent 



This matrix includes comparisons of the degree earned by respondents to the question- 
naire and the size of the district from which they are reporting. 

KEY: Number responding 13^1 Column % (Read Down) |^| Row % (Read Across) 

EXAMPLE: Read down the Uth column entitled "Ph.D/ jd.D" s 

Of the respondents from school districts with a student popluation of 300 or less, 
2,2% had Ph.D.'s or bd.D.'s. 

Of the respondents from school districts with a student population of 301-3000, 6.5% 
had Ph.D.'s or Ed.D.'s. 

Of the respondents from school districts with a student population of 3001-12,000, 

13. 0% had Ph.D.'s or Ed.D.'s. \ 

Of the respondents from school districts with a student population of 12,001-100,000, 
60.9% had Ph.D.'s or Ed.D.'s. 

Of the respondents from school districts with a student population of 100,000+, 

17. U% had Ph.D.'s or Ed.D.'s. 

Read the bottom c^ll in the A. 3. degree column with a size of over 10^,000 as: 

Of the respondents from districts of 100,000+, three had A. 3. degrees. This is 
equal to 20% of all the respondents from districts of 100,000+. 
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II 

HOURS IN STATISTICS/ SIZE 



C <0 



cj -< 

no 3 
9 C- 
« O 
c/l a. 



300 



301- 

3000 



3001- 

12,000 



12,001 

100,000 



100,000* 




Hours in 
statistics 
of respon- 
dent 



This matrix is a cross reference of the education of respondents in statistics and 
the size of the district in which they work. 



Column % (Read Dorm) 



Example: Read the bottom rot/ across- Of the Districts with enrollment of 100,00 or 

more students: 

13.3% had no hou ' s in statistics 
13.3% had 3 hours in statistics 
20.0% had 6 hours in statistics 
13.37c had 9 hours in statistics 
40.0% had more than 9 hours in statistics 
The total number of respondents from this size distract was (2, 2, 3, 2, 6) 15. 



KEY: Humber respondin'. 







Row % (Read Across) 




Read down the column marked 9+ 
statistics. 



Of the rosnondents who had more than 9 hours in 



0.0% 


wire 


from districts 


with 


0.0% 


h 


II 


It 


II 


3.8% 


it 


II 


11 


II 


73.1% 


it 


It 


M 


31 


23.1% 


it 


M 


M 


" 1 


tal number 


of 


respondents 


bavin 1 



II 

M 

41 



301-3000 
3001.-12,000 
12,001-100,000 
more than 100,000 enrollment 

tor .* than 9 hours in statistics was 



(1, 19, 6) 26. 
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HOURS IN RESEARCH DESIGN/SIZE 
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This matrix is a cross reference of the education of the respondents in research de 
sign and the siae of the district in which they work. 



KEY: number responding J^/Column$ (Read Down) Row % (Read Across )j *| 

Example: Read across the bottom row - Of the districts with enrollment of 100,000+ 



33.3$ had 0 hours of research design* 

20.0$ had 3 hours of research design 
20.0$ had 6 hours of research design 
6.7$ had 9 hours of research design 
20.0$ had more than 9 hours of research design 
The total number of respondents from districts of 100,000 or more taus (5,3*3*1,3)15 
Read down the column marked 9 + hours-Of the respondents who had 9 + hrs. of Research 
Design, 

0.0$ were from districts with less than 300 enrollment. 

11.8$ were from districts ■'.ri.th 301-3000 enrollment. 

11.8$ were from districts with 3001-12,000 enrollment. 

58.8$ were from districts with 12,001-100,000 enrollment. 

17.6$ were from districts with 100,000+ enrollment. 



The total number of respondents having more than 9 hours jf research design was 
(2,2,10,3) 17. 
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ANY COURSE IN EVALMTION/SIZE 




Any c .arse in evaluation? 



This matrix is a cross reference between whether or not the respondents had any 
course in evaluation and the size of the district in which they work. 



■ »■ —— » . tmmm> ■ ■ 

KEY: Number Re spondingj^^j Column % (Read Down) Row Jo (Read Across) 

EXAMPIE : Read across the bottom row - Of the respondents from districts of more 

than 100,000, 

33.3/2 had course (s) in evaluation 
66,7% did not have a course in evaluation 



The total number of respondents in this row (i.e. from districts of 100,000+) was 

( 5 , 10 ) 15 . 

Read down the column marked "NO" : 

0.0$ of the respondents from districts with less than 300 did not have an eval. course 
13.1# of the respondents from districts with 301-3000 did not have an eval. course. 

30.3# of the respondents from districts with 3001-12,000 did not have an eval. course. 

50.9/1> of the respondents from districts with 12,001-100,000 did not have an eval.cours 

5.752 of the respondents from districts with 100,000+ did not have an eval. course. 



The total number of respondents who did not have an evaluation course was 

( 0 , 23 , 53 , 89 , 10 ) 175 . 
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T.;ST SCORE /DEGREE 




This matrix is a cross reference of the test score made by the respondents and the 
degree they have completed. 



KEY : Number Responding 



Ef 



Column % (Read Down) 



Row % (Read Across) 



3 



EXAMPLE? Read across the bottom row - Of the people who correctly answered 22-28 



the items, 

7.1# had A. 3. degrees (3 individuals) 

35*7# had li.A. degrees (1$ individuals) 

9.5# were specialists (U individuals) 

R7.6# had Ph.D. degrees or Ed.D. degrees (20 individuals) 



of 



Read down the column marked Ph.D. /Ed.D. : 



13.0# of the respondents who answered 0-15 of the items correctly had Ph.D.'s or Ed.D.' 
U3 • 5# of the respondents who answered 16-21 of the items correctly had Ph.D.'s or Ed.D. 
U3.5# of the respondents who answered 22-23 of the items correctly had Ph.D.'s or Ed.D. 

The total number of respondents who had Ph.D.'s or .d.D.'s was (6,20,20) U6. 
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TEST SCORE/HOURS IN STATISTICS 
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This matrix is a cross reference of the test score made by the respondents and 
their education in statistics. 



KEY : Number Responding 



Column % (Read Doxm) ^x^Row ,1 (Read Across ) j^/<^ 



EXAMPLE : Read across the bottom row - Of the people who correctly answered 22-28 

of the items. 



7.5$ had no hours in statistics (3 individuals) 

1S.O/ 0 had 3 hours in statistics (6 individuals) 

20.Q/& had 6 hours in statistics (8 individuals) 

17*5,0 had 9 hours in statistics (7 individuals) 

k0.0% had more than 9 hours in statistics (16 individuals) 



Read down the column marked 9+ hours: (St=Statistics) 

7*7$ of the respondents who answered 0-lf> of the items correctly had 9 + hrs. of St. 
30.8>o of the respondents who answered 16-21 of the items correctly had 9 + hrs. of St. 
6l of the respondents who ansx^ered 22-28 of the items correctly had 9 + hrs. of St. 

The total number of respondents who had more than 9 hours of statistic was 
(2, 3, 16) 26. 
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TEST SCORE /JOURS IN RESEARCH DES GN 




This matrix is a cross reference of the test score made by the respondents and 
their education in research design. 



KEY: Number Responding 



Column % (Read Down) / X(^Row $ (Read Across) 



EXAMPLE : Read across the bottom row - Of the people who correctly answered 

22-28 of the items. 



Hi. 3$ had no hours in research design. 

21. had 3 hours in research design. 

31.0$ had 6 hours in research design. 

19.0$ had 9 hours in research design. 

lli.3$ had more than 9 hours in research design. 



The total number of respondents who made correct responses to 22-28 of the items 
was (6, ), 13, 8, 6) U2. 

Read down the column marked 9 + hours; (R.D. * Research Design) 

23*5$ of the respondents who answered 0-1$ of the items correctly had 9+ hrs. in R.D 

Ul.2$ of the respondents who answered 16-21 of the items correctly had 9 + hrs. in R. 

35*3$ of the respondents who answered 22-23 of the items correctly had 9 + hrs. in R. 

The total number of respondents who had more than 9 hours in research design was 
(U, 7, 6) 17. 
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TEST SCORE/ AN ' 7 COURSE IN EVALUATION 



0) w 




Any course in evaluation? 



This matrix is a cross reference of the test score made by the respondents and 
whether or not they had any course (s) in evaluation. 



KEY: number responding: 




Colutn.' % (Read Dow n)j^<^ Row % (Read Across) 



EXAMPLE: Read across bottom row - Of the respondents who answered 22-28 of 

the items correctly, 

36.6% had course(s) in evaluation (15 individuals) 

63.4% did not have a course in evaluation (26 individuals) 



Read down the column marked "NO": (E.C.=Evaluation Course) 

35.2% of the respondents who answered 0-15 of the items correctly did not have 
an E.C. 

50.0% of the respondents who answered 16-21 of the items correctly did not have 
an E.C. 

14.8% of the respondents who answered 22-28 of the itums correctly did not have 
an E.C. 



The total number of respondents who did not have an evaluation course was (62, 
88, 26) 176. 
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DATA 



The following information is a compilation of data from individual survey 
forms. The questions are listed here in the same order as on the survey form. 
The frequency of response is followed by the percent of responses (in parenthe- 
ses) for each question. Please note that some questions ask for a ranking re- 
sponse (1, 2, 3) and others require a simple multiple response (i.e. mark the 
tests used, etc.). A sample of the original survey form is included in the ap- 
pendix to this report. 



Pare 1 

G. Were you responsible for writing an evaluation report for your 1968-69 Title 
I or III reading project? 

yes 237 (79.3%) 

no 60. (20.1%) 



Page 2 

Educational Background 



Highest degree completed is: 



Bachelor 


20 


(6.7%) 


Master 


204 


(68.2%) 


Specialist 


21 


(7.0%) 


Doctor 


52 


(17.4%) 


Graduate hours in 


statistics are 


none 


71 


(23.7%) 


3 


83 


(27.8%) 


6 


74 


(24.7%) 


9 


35 


(11.7%) 


more than 9 


29 


(9.n) 



Graduate hours in research design are: 



none 


101 


(33.8%) 


3 


95 


(31.8%) 


6 


61 


(20.4%) 


9 


15 


(5.0%) 


more than 9 


19 


(6.4%) 


Have you taken any 


course 


work entitled 



yes 91 (30.4%) 

no 204 (68.2%) 



"evaluation"? 
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Pa~e 3 



1. Within the last 18 months I have been involved in the following programs for 
Title I and/or III evaluation purposes: 

(Three choices. Respondents who started with "A" are included in column 1; 
those who started with "B" are in column 2 . etc.) 







1 






2 




3 


A. 


Inservice workshop 


169 


(56.5%) 










B. 


Extension course 


2 


(0.7%) 


18 


(6.0%) 






C. 


University consultantship 


9 


(3.0%) 


29 


(9.7%) 


5 


(1.7%) 


D. 


Publishers workshop 


1 


(0.3%) 


13 


(4.3%) 


13 


(4.3%) 


E. 


Program of local 


2 


(0.7%) 


15 


(5.0%) 


8 


(2.7%) 




I.R.A. council 














F. 


Program of state department 


43 


(14.4%) 


45 


(15.1%) 


24 


(8.0%) 




of public instruction 














G * 


Other (please specify) 


31 


(10.4%) 


8 


(2.7%) 


8 


(2.7%) 


Number 


of years of operation of your 


Title 


I and/or 


III project 


is: 





A. 


1 


14 


(4.7%) 


B. 


2 


12 


(4.0%) 


C. 


3 


93 


(31.1%) 


D. 


4 


173 


(57.9%) 



3. The total number of public school pupils (K-12) in your district is: 



A. 


300 or 


less 


1 


(0.3%) 


B. 


301-3, 


000 


34 


(11.4%) 


C. 


3,001- 


12,000 


81 


(27.1%) 


D. 


12,001 


-100,000 


164 


(54.8%) 


- E *i 


100,000+ 


17 


(5.7%) 



4. What process led to the establishment of the reading project? 



A. A survey of needs resulting in a 

project plan 

B. A project plan developed by a com- 

mittee of teachers & administrators 
_C. A plan developed by administrators 
and supervisors 

D. A community group request for a 

project 

E. Do not know or not sure 



186 


(62.2%) 


50 


(16.7%) 


43 


(14.4%) 


3 


r .o%) 


10 


(3.3%) 
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5. Reading instruction for this project is typically conducted in groups of: 
(check most appropriate term) 



A. 


2-3 


29 


(9.7%) 


B. 


3-10 


172 


(57.5%) 


C. 


10-15 


55 


(18.4%) 


D. 


Whole class 


11 


(3.7%) 


E. 


Individualized instruction 


20 


(6 . 7%) 
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6. This method of grouping was prescribed because: 

35 (1 1.7%) 
14 (4.7%) 

236 (78.9%) 
3 (i.0%) 

IX- »Data Collection 



A. More children are reached 
_B. It is suited to the size of the avail- 
able classroom 

C. Pupil needs are met best 

D. It is less expensive 



7. As an evaluator of the reading project, were you requested to evaluate the 
objectives of the project? 



Yes 225 (75.3%) 

Wo 61 (20.4%) 



8 . 



If "Yes” above, what procedures did you use in making your evaluation of 
the objectives? (rank 1, 2, 3). 

12 3 

A . Discussed objectives with local special- 25(8. 47«) 73(24.4%) 4(1.3%) 

ists to see whether they were feasible 

B. Related objectives to surveyed needs 85(28.4%) 21(7.0%) 6(2.0%) 

C . Submitted objectives to a board of experts 1 (0.37c.) 3(1.0%) 31(10.47.) 

D. Other (Specify) 9(3.0%) 4(1.3%) 21(7.0%) 



9. TJere you requested to evaluate instructional procedures used in the project? 



Yes 144 (48.27>) 

Wo 142 (47.5%) 



Page 5 

10. If "Yes''' above, did you make recommendations to change any instructional 
procedures? 

Yes 121 (40.5%) 

_No 37 (12*47») 

11. If ’’Yes" above, were changes made during the project as a result of your 
recommends t ions ? 

Yes 111 (37.17a) 

No 13 (4.3%) 

12. Did you participate in the evaluation of teaching materials? 

Yes 154 (51.5%) 

. Wo 131 (43.8%) 
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13. 



If "Yes”, Indicate the sources for developin'"; the criteria for evaluating 
the materials. (Rank 1, 2, 3.) 



_A. 

y>. 

”c. 

"d. 

"e. 



Books on evaluation 6(2.0%) 

Expert (e.;*. consultant) 37(12.4%) 

Publishers representatives 3(1.0%) 

>.ocal teachers 44(14.7%) 

Other Title I projects 7(2.3%) 



2 

8(2.7%) 

34(11.4%) 

9(3.0%) 

32(10.7%) 

12(4.0%) 



14(4.7%) 

8(2.7%) 

25(8.4%) 

14(4.7%) 

22(7.4%) 



14. Were you involved in evalu tion of Title I staff? 



Yes 153 (51.2%) 

"No 134 (44.8%) 



15. 



"Yes 


" above, indicate methods used to 


f ather data. 


(Rank 1, 


2, 3.) 






1 


2. 


3 


A. 


Personal classroom observation 


72(24.1%) 


16(5.4%) 


6(2.0%) 


B. 


Teacher's lor or lesson plan 


2(0.7%) 


18(6.0%) 


21(7.0%) 


C. 


Principal report 


12(4.0%) 


34(11.4%) 


13(4.3%) 


0. 


Questionnaire 


8(2.7%) 


12(4.0%) 


14(4.7%) 


E. 


Interview 


1(0.3%) 


10(3.3%) 


14(4.7%) 


?. 


Consultant's report from 


3(1.0%) 


4(1.3%) 


7(2.3%) 




observation 








r '. 


Supervisor's report 


1(0.3%) 


5(1.7%) 


14(4.7%) 


H. 


Other (specify) 


3(1.0%) 


1(0.3%) 


2(0.7%) 



Pase 6 
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Indicate the teacher evaluation instrument used. (Two choices. Respondents 
who started with "A" are included in Column 1; those who started with "C" 
are in Column 2.) 



A. 

‘b. 



D. 

'e. 



Flanders Interaction Analysis 3(1.0%) 

Amidon Teacher Analysis Form 0(f). G7«) 0(0.0%) 
Locally devised rating scale 101(33.8%) 2(0.7%) 
Hone 60 (2) . 1%) 0 (0 . 0%) 
Other (specify) 10(6.0%) 10(3.3%) 



17. Indicate methods used to collect data for your total evaluation. (Rank 
2, 3.) 



ji. 

"B. 

”c. 

J3. 

E. 



■ 

r* 



12 3 

Visit reading classes 52(17.4%) 29(9.7%) 29(9.7%) 

Discussions with teachers 14(4.7%) 57(19.1%) 48(16.1%) 

Examine results of testin'"; pro ram 132(44.1%) 41(13.7%) 30(10.0%) 

Pupil reactions 5(1.7%) 14(4.7%) 44(14.7%) 

Written reports from teachers 18(6.0%.) 70(23. 4%>) 29(9.7%) 

Reports from supervisors 8(2.7%) 17(5.7%) 35(11.7%) 

Others (ascribe) 5(1.7%) 4(1.3%) 12(4.0%) 
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XIX-~Rcportln": 



18. To whom arc the results of Title I projects reported? (Rank 1, 2, 3.) 

12 3 



A. 


U. S. Oovernmcnt 


3(1.0%) 


1(0.3%) 


5(1.77.) 


B. 


State department of education 


49(16.4%) 


30(10.0%) 


16(5.47.) 


• 


,ocal school board 


127(42.5%) 


62(20.77.) 


15(5.07.) 


0. 


Community groups (specify) 


31(10.4%; 


67(22.4%) 


67(22.4%) 


E. 


Newspaper, radio, etc. 


1(0.3%) 


0(0.0%) 


16(5.4%) 


r? 


Parents (specify) 


1(0.3%) 


2(0.77.) 


5(1.77.) 


G. 


Faculty and staff 


2(0.77.) 


10(3.37.) 


13(4.37.) 


H. 


Pupils 


17(5.77.) 


30(10.0%) 


66(22.1%) 


I. 


Supervisory personnel 


5(1.7%) 


1(0.3%) 


1(0.3%) 


J. 


Other (specify) 


11(3.77.) 


41(13.7%) 


32(10.77.) 



19. Indicate the type(s) of reports you were requested to make. (Three choices. 
Respondents who started with "A" are included in Column 1; those who started 
with "B" in Column 2 , etc.) 

1 % 2 3 

A . Anecdotal 79(26.4%) 

B. narrative 162(54.2%) 68(22.77.) 

C. Statistical 44(14.77.) 157(52.57.) 60(20.1%) 

D. Other (specify)6(2.0V.) 6(2.07;) 8(2.77.) 



20 . 



For what purposes are reports of Title I 

A . Future financial support 

B. T .ocal publicity 

C . Federal regulation 

D. decision ref:ardinc; status 

of project 

E. Periodic progress during the 

year 

i 7. Annual report to Board of 
Education 



projects made? (Rank 1. , 



1 

20(6.77.) 

1(0.37.) 

132(44.17;) 

54(18.17.) 

32(10.77.) 

5(1.77.) 



2 

52(17.47.) 

1(0.3%) 

35(11.7%) 

80(26.8%) 

34(11.4%) 

39(13.07.) 



2, 3). 

3 

52(17.47.) 

9(3.0%) 

35(11.7%) 

49(16.47.) 

33(11.07.) 

52(17.47;) 



21. IJhat means were used to make public the results of the Title I project? 

(Three choices. Respondents who started with "A" are included in Column 1; 



those x;ho started with "B" are in Column 

A. Newspaper articles 

B. Reports to parents, written 


2, etc.) 

1 

172(57.5%) 

32(10.7%) 


2 

72(24.1%) 


3 


C. 


Radio interviexjs 


0(0.0%) 


14(4.7%) 


12(4.07;) 


i). 


Reports to P.T.A. 


17(5.7%) 


48(16.1%) 


36(12.0%) 


E. 


Reports to community service 
organizations 


4(1.3%) 


21(7.0%) 


45(15.1%) 


*‘7 
■. • 


Reports to Board of Education 


38(12.77;) 


54(10.17.) 


53(17.77.) 


A 

Vj « 


Uritten report — circulated in 
community 


1(0.37;) 


4(1.3%) 


17(5.77.) 


H. 


Other (specify) 


11(3.7%) 


12(4.0%) 


4(1.3%) 
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Page 8 
IV--Tests 
22 . 



In your Judgment, the most reliable measures 
the reading project are: (Rani; 1, 2, 3.) 



of the decree of success of 



23. 



A. 


Statistics derived from pro- and 


108(36.1%) 


46(15.4%) 


56(18.7%) 


B. 


post-tests 

Pupils reading at grade level 


14(4.7%) 


20(6.7%) 


14(4.7%) 


c. 


Parent response 


1(0.3%) 


6(2.0%) 


19(6.4%) 


D. 


Responses from classroom teachers 


33(11.0%) 


62(20.7%) 


56(18.7%) 


E. 


Extent of pupil participation in 


34(11.4%) 


20(9.4%) 


26(0.7%) 


F. 


activities 

Pupils readin’- near expectancy 


64(21.4%) 


57(19.1%) 


30(10.0%) 


G. 


level 

Reading teacher reports 


19(6.4%) 


40(13.4%) 


41(13.7%) 


H. 


Reports from supervisors 


3(1.0%) 


7(2.3%) 


11(3.7%) 


I. 


Classroom visitation 


3(1.0%) 


0(2.7%) 


16(5.4%) 


In your judgment, the most reliable measure 


:S of pupil 


progress are: 


(Rani; 


1, 2, 3) 


• 


1 


2 


3 


A. 


Standardized test results 


1(0.3%) 


0(0.0%) 1(0.3%) 



B. 

‘c. 

3 . 



G. 

“H. 

”i. 

"j. 

"ic. 



Reading grades on report card 120(40.1%) 

Academic grades on report card 0(0.0%) 

Reading teacher evaluation 0(0.0%) 

Oral reading in the classroom 98(32.8%) 

Pupil’s self-evaluation 6(2.0%) 

Classroom teacher evaluation 21(7.0%) 

Informal test results 19(6.4%) 

Number of books read by pupil 18(6.0%) 

Completion of basal reader 1(0.3%) 

Completion of reading workbook 0(0.0%) 



50(16.7%) 
4(1.3%) 
6(2.0%) 
94(31.4%) 
12(4.0%) 
35(11.7%) 
45(15.1%) 
2G (9.4%) 
6(2.0%) 
1(0.3%) 



Page 9 

24. IJhnt test design was used in evaluating the project? 



ji. 

>. 

’c. 

"o. 

"e. 



Pre-test/post-test 263(88.0%) 

Aocal data comparison 12(4.0%) 

National norm comparison 8(2.7%) 

Test of difference between groups 3(1.0%) 

Other (describe) 4(1.3%) 



25. Standardized reading test scores indicate: 



_A. 

~G. 

"c. 



Independent readin level 88(29.4%) 
Instructional readin'- level 99(33.1%) 
Frustration reading; level 81(27.1%) 



54(18.1%) 

6 ( 2 . 0 %) 

8(2.7%) 

25(8.4%) 

13(4.3%) 

55(18.4%) 

60(20.1%) 

34(11.4%) 

12(4.0%) 

1(0.3%) 



O 

ERIC 
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Use the following list of tests to answer the question below: 

1. Doran Diagnostic 

2. Spitzer Test 

3. California Ueadinr Test 

4. Dolch Test of 220 Words 

5 . Kelson- Denny 

6. Gray Oral 

7 . Informal Ueadinr: Inventory 

8. Peabody Picture Vocabulary Test 

Page 10 

26. ^Jhich of the following reading skills are tested by the instruments indi- 
cated above? Write the number of the test next to the skill that it pur- 
ports to measure. 

A. Phonics-word attack 

1 2 3 4 5 6 7 8 

97(32.4%) 3(1.0%) 9(3.0%) 19(6.4%) 2(0.7%) 30(10.0%) 20(6.7%) 7(2.3%) 

B. Sight vocabulary 

1 2 3 4 5 6 7 8 

10(3.3%) 1(0.3%) 7(2.3%) 168(56.2%) 3(1.0%) 9(3.0%) 9(3.0%) 21(7.0%) 

C. Study skills 

1 2 3456 78 

12(4.0%) 91(30.4%) 40(13.4%) 1(0.3%) 10(3.3%) 2(0.7%) 15(5.0%) 0(0.0%) 

D. Paragraph comprehension- silent reading 

12345678 
4(1.3%) 3(1.0%) 128(42.8%) 4(1.3%) 23(7.7%) 18(6.0%) 43(14.4%) 0(0.0%) 

E. ‘Critical reading skills 

1 23 456 78 

43(14.4%) 9(3.0%) 38(12.7%) 4(1.3%) 18(6.0%) 26(8.7%) 23(7.7%) 0(0.0%) 

F. Secondary level reading comprehension 

12345 678 

2(0.7%) 11(3.7%) 53(17.7%) 5(1.7%) 102(34.1%) 8(2.7%) 10(3.3%) 0(0.0%) 

The following are types of tests often used in reading projects: 

1. Achievement test (standardized, California) 

2. Diagnostic reading test (standardized, group, Bond- Clymer- Hoyt) 

3. Individual diagnostic reading test (Durrell) 

4. Informal reading inventory 

5. Interest inventory 

6. Language and concept inventory(P ea b 0< ty) 

27. Use the above listed types of tests, and write the number of the type which 
would be appropriate for measuring or evaluating the following objectives: 

A. Improve all pupils reading through a developmental program 

1 2 3 4 5 6 

153(51.2%) 72(24.1%) 11(3.7%) 10(3.3%) 2(0.7%) 4(1.3%) y 
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1 

6 ( 2 . 0 %) 



1 

3 ( 1 . 0 %) 



1 

6 ( 2 . 0 %) 



B. Correct specific reading difficulties through a remedial reading 

program 

2 3 4 5 6 

58 ( 19 . 4 %) 175 ( 58 . 5 %) 16 ( 5 . 4 %) 0 ( 0 . 0 %) 3 ( 1 . 0 %) 

C. Enrich children's experiences for reading through field trips 

2 3 4 5 6 

0 ( 0 . 0 %) 0 ( 0 . 0 %) 29 ( 9 . 7 %) 124 ( 41 . 5 %) 82 ( 27 . 4 %) 

D. Encourage wide reading through appropriate book selection 

2 3 4 5 6 

4 ( 1 . 3 %) 2 ( 0 . 7 %) 89 ( 29 . 8 %) 126 ( 42 . 1 %) 15 ( 5 . 0 %) 



O 

ERIC 
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